Multimodal Resources for Human-Robot Communication Modelling
نویسندگان
چکیده
This paper reports on work related to the modelling of Human-Robot Communication on the basis of multimodal and multisensory human behaviour analysis. A primary focus in this framework of analysis is the definition of semantics of human actions in interaction, their capture and their representation in terms of behavioural patterns that, in turn, feed a multimodal human-robot communication system. Semantic analysis encompasses both oral and sign languages, as well as both verbal and non-verbal communicative signals to achieve an effective, natural interaction between elderly users with slight walking and cognitive inability and an assistive robotic platform.
منابع مشابه
Evaluation of Unimodal and Multimodal Communication Cues for Attracting Attention in Human-Robot Interaction
One of the most common tasks of a robot companion in the home is communication. In order to initiate an information exchangewith its human partner, the robot needs to attract the attention of the human. This paper presents results of two user studies (N = 12) to evaluate the effectiveness of unimodal and multimodal communication cues for attracting attention. Results showed that unimodal commun...
متن کاملAchieving Multimodal Cohesion during Intercultural Conversations
How do English as a lingua franca (ELF) speakers achieve multimodal cohesion on the basis of their specific interests and cultural backgrounds? From a dialogic and collaborative view of communication, this study focuses on how verbal and nonverbal modes cohere together during intercultural conversations. The data include approximately 160-minute transcribed video recordings of ELF interactions ...
متن کاملMultimodal Human-Machine Interaction for Service Robots in Home-Care Environments
This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.
متن کاملToward Robot Adaptation of Human Speech and Gesture Parameters in a Unified Framework of Proxemics and Multimodal Communication
In this work, we present our unified framework of proxemics and multimodal communication based on static data-driven models of how social signals (speech and gesture) are produced and perceived by both a social robot and a human user, and propose extensions to enable dynamic model adaptation of these human communication parameters.
متن کاملUnified Incremental Multimodal Interface for Human - Robot Interaction
Face-to-face human communication is a multimodal and incremental process. Humans employ different information channels (modalities) for their communication. Since some of these modalities are more error-prone to specific type of data, a multimodal communication can benefit from strengths of each modality and therefore reduce ambiguities during the interaction. Such interfaces can be applied to ...
متن کامل